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Abstract  (U) 


The  Situation  Analysis  Support  Systems  (SASS)  Group  in  the  Decision  Support 
Systems  (DSS)  Section  at  Defence  Research  &  Development 

Canada  (DRDC)  -  Valcartier  is  currently  investigating  advanced  concepts  for  adaptation 
and  integration  of  the  data  fusion  and  sensor  management  processes.  These  concepts 
could  apply  to  any  current  Canadian  military  platform’s  sensor  suite,  as  well  as  its 
possible  future  upgrades,  to  improve  its  performance  against  the  predicted  future  threat. 
The  reported  work  addresses  the  problem  of  automatically  aggregating  information 
from  multiple  data  sources.  “Multiple  Source  Data  Fusion”  (MSDF)  is  used  to  indicate 
the  general  approach  for  combining  the  sensor  data  into  global  tracks.  The  selection  of 
the  appropriate  MSDF  techniques  depends  on  the  underlying  architecture.  For  the 
centralized  scheme,  the  sources  are  known  to  be  independent  and  the  Kalman  filter 
provides  an  optimal  solution.  Unfortunately,  when  the  decentralized  architecture  is 
used  the  sources  become  correlated  and  the  Kalman  filter  cannot  be  applied.  The 
covariance  intersection  method  has  been  proposed  as  a  solution  to  the  problem  of  the 
decentralized  data  fusion,  but  results  in  a  decrease  in  performance.  A  new  fusion 
algorithm,  that  avoids  both  the  inconsistency  of  the  Kalman  filter  and  the  lack  of 
performance  of  the  covanance  intersection,  is  proposed.  The  superiority  of  the 
proposed  approach  is  illustrated  through  the  target’s  tracking  problem. 


Resume  (U) 


Des  activitds  de  recherche  entreprises  par  le  groupe  syst&mes  d’aide  it  l’analyse  de  la 
situation  (SAAS)  de  la  section  systemes  d’aide  a  la  decision  (SAD),  a  Recherche  et 
Development  pour  la  Defence  Canada  (RDDC)  -  Valcartier,  concernent  I’Stude  des 
concepts  avances  pour  l’adaptation  et  l’integration  des  processus  de  fusion  des  donnees 
et  de  gestion  des  capteurs.  Ces  concepts  pourraient  profiter  au  systfcme  de  capteurs  des 
plates-formes  militaires  canadiennes.  Ce  rapport  aborde  le  probleme  de  l’agrcgation  de 
T  information  emanant  de  differentes  sources.  La  “Fusion  de  Donnees  Multi-Sources 
(FDMS)”  designe  l’ensemble  des  techniques  permettant  la  combinaison  des  donnees 
des  capteurs  en  une  seule  piste  globale.  Le  choix  d’une  technique  appropriee  pour  cette 
combinaison  ddpend  de  F architecture  du  systeme  FDMS  sous-jacent.  Pour  une 
architecture  centralisee,  les  sources  sont  independantes  et  le  filtre  Kalman  offre  une 
solution  optimale.  Toutefois,  dans  une  architecture  decentralisde,  une  correlation  peut 
se  creer  entre  les  sources,  et  le  filtre  Kalman  ne  peut,  par  consequent,  etre  utilise.  La 
methode  de  1’intersection  des  covariances  a  et6  proposee  comme  solution  de  rechange 
au  filtre  Kalman,  pour  la  fusion  des  sources  correlees.  Elle  engendre  toutefois  une 
diminution  de  la  performance.  Un  nouveau  filtre,  qui  permet  &  la  fois  d’dviter 
l’inconsistance  du  filtre  Kalman  et  la  baisse  de  performance  de  l’intersection  des 
covariances,  est  proposd  dans  ce  document.  La  superiorite  de  l’approche  proposee  est 
illustrde  pour  le  probleme  de  pistage  de  cibles. 
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Executive  summary  (U) _ 

“Multiple  Source  Data  Fusion”  (MSDF)  is  used  to  indicate  the  general  approach  for 
combining  the  sensor  data  into  global  tracks.  Since  the  benefits  of  a  fusion  process  are 
very  dependent  on  the  way  the  sensor  data  are  combined,  the  selection  of  the 
appropriate  architecture  represents  a  fundamental  conceptual  issue  in  developing 
surveillance  and  tracking  systems.  Hence,  the  architecture  of  an  MSDF  system  can 
range  from  highly  centralized  to  highly  distributed.  In  the  centralized  approach,  each 
individual  sensor  transmits  its  contacts  to  the  fusion  centre,  where  they  serve  to  update 
and  maintain  a  single  master  track  file.  On  the  contrary,  the  decentralized  architecture 
allows  each  sensor  to  perform  a  maximum  amount  of  pre-processing  to  generate  sensor 
output  decisions.  Hence,  each  sensor  individually  maintains  its  own  track  file  based 
exclusively  upon  its  own  measurement  data  processed  by  the  local  tracker.  These 
sensor-level  tracks  are  then  transmitted  to  a  central  fusion  node  responsible  for  fusing 
them  into  composite  tracks  to  form  a  master  track  file. 

The  selection  of  the  appropriate  MSDF  techniques  depends  on  the  underlying 
architecture.  For  the  centralized  scheme,  the  sources  ( i.e .,  contacts)  are  known  to  be 
independent.  In  this  case,  the  Kalman  filter  provides  an  optimal  solution.  This 
independence  assumption  can  however  be  relaxed  in  the  case  of  correlated  data,  if  the 
cross-covariance  information  is  available.  Unfortunately,  if  this  correlation  information 
is  missing  the  Kalman  filter  cannot  be  applied.  The  case  of  correlated  sources  occurs 
particularly  when  the  decentralized  architecture  is  used.  The  pieces  of  data  to  be  fused 
(i.e.,  sensor-level  tracks)  are  not  statistically  independent.  In  such  situations, 
independence  is  often  assumed  and  the  correlation  is  simply  ignored  in  the  fusion 
process,  to  allow  for  the  use  of  the  Kalman  filter.  This  makes  the  filter  over  optimistic 
in  its  estimation,  which  may  lead  to  divergence.  This  property  is  known  as  the 
inconsistency  phenomenon.  The  covariance  intersection  method  has  been  proposed  as  a 
robust  solution  to  the  problem  of  the  decentralized  data  fusion  in  the  presence  of  an 
unknown  correlation.  To  avoid  the  underestimation  of  the  actual  covariance  matrix,  the 
covariance  intersection  overestimates  it,  which  results  in  a  decrease  in  performance.  To 
avoid  both  the  inconsistency  of  the  Kalman  filter  and  the  lack  of  performance  of  the 
covariance  intersection,  a  new  fusion  algorithm,  called  the  largest  ellipsoid,  is 
proposed.  The  proposed  algorithm  does  not  overestimate  the  intersection  region,  as 
does  the  covariance  intersection,  but  slightly  underestimates  it.  This  will  have  no  effect 
on  the  consistency  of  the  fusion,  since  the  intersection  region  represents  an  upper  bound 
for  the  actual  covariance.  The  three  methods  discussed  are  compared  through  the 
target’s  tracking  problem,  where  the  superiority  of  the  proposed  filter  is  clearly  shown. 

This  document  describes  a  part  of  the  ongoing  activity  undertaken  by  the  Situation 
Analysis  Support  Systems  (SASS)  Group  in  the  Decision  Support  Systems  (DSS) 
Section  at  Defence  Research  &  Development  Canada  (DRDC)  -  Valcartier.  This 
research  activity  concerns  the  investigation  of  advanced  concepts  for  the  adaptation  and 
the  integration  of  the  data  fusion  and  sensor  management. 
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The  results  of  this  research  could  apply  to  any  current  Canadian  military  platform 
sensor  suites  and  the  possible  future  upgrades  to  improve  their  performance  against 
predicted  future  threat. 


Abder  Rezak  Benaskeur  and  Jean  Roy.  2002.  A  consistent  filter  for  robust  decentralized  data 
fusion.  TR  2001-223.  Defence  Research  &  Development  Canada  -  Valcartier. 
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Sommaire  (U) 


La  fusion  de  donntes  multi-sources  sert  a  determiner  une  demarche  d’ensemble  afin  de 
combiner  les  donntes  des  capteurs  en  une  seule  piste  globale.  Comme  les  avantages  du 
processus  de  fusion  dependent  beaucoup  de  la  fa?on  dont  sont  combinees  les  donntes, 
le  choix  de  1’ architecture  approprite  est  fondamental  dans  la  mise  au  point  de  systtme 
de  surveillance  et  de  poursuite.  L’ architecture  du  systtme  de  fusion  de  donnees 
multi-sources  peut  etre  tres  centralisee  ou  distribute.  Dans  une  architecture  centralisee, 
chacun  des  capteurs  renvoie  les  sources  k  un  centre  de  fusion.  Par  contre,  1’ architecture 
dtcentraliste  permet  a  chacun  des  capteurs  d’effectuer  un  pre-traitement  afin  d’en 
arriver  k  une  dtcision. 

Le  choix  des  techniques  appropriees  de  fusion  de  donnees  multi-sources  depend  de 
1’  architecture  sous-jacente.  Dans  le  modele  centralist,  les  sources  (contacts)  sont 
indtpendantes.  Le  filtre  Kalman  constitue  la  meilleure  solution.  Cette  condition 
d’indtpendance  tombe  dans  le  cas  de  donntes  qui  sont  statistiquement  dtpendantes  et 
dont  on  dispose  de  l’information  d’ inter-covariance.  Malheureusement,  on  ne  peut 
utiliser  le  filtre  Kalman  lorsqu’on  ne  posskde  pas  cette  information  sur  la  corrtlation. 

La  question  des  sources  corrtltes  se  pose  surtout  lorsqu’on  utilise  une  architecture 
dtcentraliste.  Les  rtsultas  de  la  fusion  (pistes)  ne  sont  pas  statistiquement 
indtpendantes.  Dans  ce  cas,  on  presuppose  gtntralement  qu’elles  le  sont  et  on  ne  tient 
pas  compte  de  1’ inter-covariance  dans  le  processus  de  fusion,  afin  de  pouvoir  utiliser  le 
filtre  Kalman.  Cette  ntgligence  a  toutefois  tendance  a  sous-estimer  la  matrice  de 
covariance  de  l’erreur  d’estimation.  Cette  caracteristique  s’appelle  le  phenomene 
d’inconsistance. 

La  mtthode  “intersection  des  covariances  ”  a  ttt  proposte  pour  rtsoudre  le  probleme 
de  la  fusion  dtcentraliste  de  donntes  en  presence  de  corrtlation  inconnue.  Pour  tviter 
de  sous-estimer  la  matrice  de  covariance  rtelle,  ^intersection  des  covariances  la 
surestime,  ce  qui  entraTne  une  diminution  de  la  performance.  Pour  tviter  k  la  fois 
l’incohtrence  du  filtre  Kalman  et  la  faible  performance  de  l’intersection  des 
covariances,  on  a  propost  un  nouvel  algorithme  de  fusion  :  la  “plus  grande  ellipsoi'de  ”. 
Contrairement  a  l’intersection  des  covariances,  cet  algorithme  ne  surestime  pas  la  zone 
d’ intersection,  mais  la  sous-estime  ltgkrement.  Ceci  n’a  aucun  effet  sur  la  consistance 
du  rtsultat  de  la  fusion,  puisque  la  zone  d’ intersection  reprtsente  la  limite  superieure  de 
la  covariance  rtelle.  On  a  compart  les  trois  mtthodes  dans  le  cadre  de  la  poursuite  de 
cibles,  ok  la  suptrioritt  du  filtre  propost  a  ttt  clairement  dtmontrte. 

Ce  document  decrit  une  partie  d’une  activitt  en  cours  entreprise  par  le  Groupe  des 
systtmes  d’aide  k  l’analyse  de  la  situation  (SAAS)  de  la  Section  des  systkmes  d’aide  a 
la  dtcision  (SAD)  de  Recherche  et  dtveloppement  pour  la  dtfense  Canada  (RDDC)  - 
Valcartier.  Cette  activitt  de  recherche  porte  sur  l’ttude  de  concepts  avancts  pour 
l’adaptation  et  l’inttgration  de  la  fusion  de  donntes  et  la  gestion  des  capteurs. 

Les  rtsultats  de  cette  recherche  pourraient  profiter  au  systtme  de  capteurs  des 
plates-formes  militaires  canadiennes,  ainsi  qu’a  ses  amtliorations  possibles  a  venir  afin 
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d’en  accroltre  la  performance  contre  les  menaces  futures  anticipees. 


Abder  Rezak  Benaskeur  and  Jean  Roy.  2002.  Un  filtre  consistant  pour  la  fusion  decentralisee 
robuste  de  donnees.  TR  2001-223.  Recherche  et  Development  pour  la  Defence 
Canada  -  Valcartier. 
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1 .  Introduction 


An  ongoing  activity  undertaken  by  the  Situation  Analysis  Support  Systems  (SASS) 
Group  in  the  Decision  Support  Systems  (DSS)  Section  at  Defence  Research  & 
Development  Canada  (DRDC)  -  Valcartier  is  the  investigation  of  advanced  concepts  for 
adaptation  and  integration  of  the  data  fusion  and  sensor  management.  These  concepts 
could  apply  to  any  current  Canadian  military  platform  sensor  suites,  as  well  as  the 
possible  future  upgrades,  in  order  to  improve  their  performance  against  the  predicted 
future  threat  [1], 

The  reported  work  addresses  the  problem  of  automatically  aggregating  and  extracting 
the  desired  information  from  multiple  limited  accuracy  sensor/source  data,  in  arbitrary 
fusion  architecture.  In  most  situations,  the  combination  of  such  multiple  source  data 
allows  for  achieving  more  accuracy  than  could  be  achieved  by  the  use  of  single  source 
systems  and  yields  more  usable  compromises.  The  term  “Multiple  Source  Data  Fusion 
(MSDF)  architecture”  is  used  to  indicate  the  general  method  (or  philosophy)  used  to 
combine  the  sensor  data  into  global  tracks.  The  following  Joint  Director  Laboratory 
(JDL)  definition  of  MSDF  is  being  reported  in  [2]. 


"A  continuous  process  dealing  with  association,  correlation,  and 
combination  of  data  and  information  from  multiple  sources  to  achieve  refined 
entity  position  and  identity  estimates,  and  complete  and  timely  assessments  of 
resulting  situations  and  threats,  and  their  significance". 


1.1  Fusion  net  architecture 

For  any  given  sensor  suite  configuration,  there  can  be  many  different  ways  to  combine 
data  from  the  sensors.  Therefore,  a  fundamental  conceptual  issue  in  developing  an 
MSDF  system  for  surveillance  and  tracking  purposes  is  the  selection  of  the  appropriate 
architecture  [3, 4,  5, 6].  This  issue  revolves  about  defining  where  to  combine  or  fuse  the 
data  in  the  processing  flow  of  multiple  sensors,  or  equivalently  the  level  of 
pre-processing  of  the  information  data  that  is  fused. 

The  MSDF  architecture  is  an  important  issue  since  the  benefits  of  the  fusion  process  are 
different  depending  on  the  way  the  sensor  data  are  combined  [7].  Within  the  surveyed 
literature,  many  different  ways  to  combine  data  from  multiple  sensors  have  been  found, 
offering  as  many  architectural  options  to  the  MSDF  system  designer.  The  architecture 
of  an  MSDF  system  can  range  from  highly  centralized  to  highly  distributed  [8]. 
Examples  of  these  two  extreme  architectures,  for  surveillance  and  tracking 
applications,  are  given  below. 

1 .1 .1  Centralized  data  fusion  architecture 

When  the  centralized  fusion  architecture  is  used,  each  individual  sensor 
transmits  its  raw  observations  (or  contact)  to  the  fusion  node  where  the 
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required  processes  are  performed  to  generate  and  update  global  composite 
tracks,  maintained  in  a  single  master  track  file  [7].  The  central  fusion  process 
performs  the  functions  of  data  alignment,  data  association,  target  state 
estimation  and  kinematic  behavior  assessment,  identification  information 
fusion  and  track/cluster  management  to  achieve  joint  estimates  of  the  position, 
velocity,  attnbutes  or  identity  of  entities  in  the  environment. 


1 .1 .2  Decentralized  data  fusion  architecture 

The  decentralized  sensor  fusion  architecture  allows  each  sensor  to  perform  a 
maximum  amount  of  pre-processing  to  generate  sensor  output  decisions  (such 
as  state  vectors  and  declarations  of  identity)  for  the  various  entities  in  the 
environment  [9].  Independent  target  detection,  features  extraction,  state 
estimation  and  identification  are  thus  potentially  performed  within  the  signal 
processor  and  tracker  of  each  sensor  [7].  The  resulting  target  track  data  is 
normally  stored  in  a  track  file.  Hence,  each  sensor  individually  maintains  its 
own  track  file  based  exclusively  upon  its  own  measurement  data  processed  by 
the  local  tracker  [10].  These  sensor-level  tracks  are  then  transmitted  to  a 
central  fusion  process  responsible  for  both  finding  the  sensor  tracks  that  likely 
represent  the  same  target,  and  for  combining  or  fusing  these  tracks  into 
composite  tracks  to  form  a  master  track  file.  Within  the  central  fusion  process, 
data  alignment,  gating,  assignment  and  fusion  (positional  and/or  identity)  are 
performed  on  state  vectors  rather  than  on  raw  data. 


1.2  Fusion  algorithm 

The  selection  of  the  appropriate  MSDF  algorithms  and  techniques  depends  on  the 
fusion  architecture  [7].  Hence,  before  an  MSDF  function  can  be  implemented  within  a 
combat  system,  it  must  be  analyzed  in  terms  of  the  different  types  of  architectures  and 
implementations  that  are  possible,  the  benefits  and  drawbacks  of  these  architectures, 
and  finally  in  terms  of  how  all  this  relates  to  the  performance  and  mission  requirements 
of  the  platform. 


1 .2.1  Fusion  algorithm  for  centralized  architecture 

For  the  centralized  scheme,  the  sources  of  information  to  be  fused  (i.e., 
contacts)  are  known  to  be  statistically  independent1.  In  this  case,  the  Kalman 
filter  yields,  in  the  mean  square  error  sense,  the  best  performance  [11]. 


‘Two  random  variables  are  independent,  if  their  joint  probability  density  is  the  product  of  their  marginal  (indi¬ 
vidual)  probability  densities. 
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1 .2.2  Fusion  algorithm  for  decentralized  architecture 

The  independence  assumption  can  be  relaxed  in  the  case  of  correlated2  data,  if 
the  cross-covariance  information  is  available.  In  this  case,  the  Kalman  filter 
will  still  provide  the  best  performance,  by  exploiting  this  additional 
information.  Unfortunately,  if  this  correlation  information  is  missing  or 
incomplete,  which  is  often  the  case,  the  Kalman  filter  cannot  be  applied.  This 
represents  a  major  drawback,  since,  in  practical  applications,  the  complete 
independence  of  the  sources  cannot  be  guaranteed  and  the  cross-covariance  is 
rarely  available. 

The  above-mentioned  case  of  correlated  sources  occurs  when  the 
decentralized  architecture  is  used.  The  pieces  of  data  to  be  fused  (t.e., 
sensor-level  tracks)  are  not  guaranteed  to  be  statistically  independent,  due 
mainly  the  common  process  noise  and  target’s  maneuvers  that  represent 
unavoidable  sources  of  correlation.  In  such  situations,  to  allow  for  the  use  of 
the  Kalman  filter,  the  independence  is  often  assumed  and  the  correlation  is 
simply  ignored  in  the  fusion  process.  This  makes  the  filter  over  optimistic  in 
its  estimation,  which  may  lead  to  divergence  [12].  The  Kalman  filter 
underestimates,  in  such  a  case,  the  actual  error  covariance.  This  property  is 
known  as  the  inconsistency  phenomenon.  One  common  solution,  to  avoid  this 
problem,  consists  in  increasing  artificially  the  estimated  covariance  matrix,  by 
introducing  an  empirically  determined  parameter.  Since  no  rigorous  method 
exists  for  choosing  such  a  parameter  [13],  the  reliability  of  the  fusion  process 
can  be  greatly  compromised. 

The  covariance  intersection  method  has  been  proposed  recently  [14]  to  bring  a 
robust  solution  to  the  problem  of  decentralized  data  fusion  in  presence  of  an 
unknown  and  un-modeled  correlation.  This  method  allows  for  avoiding  the 
inconsistency  phenomenon,  by  replacing  the  Kalman  filter  fusion  rule  by  a 
more  conservative  one.  Since  the  covariance  intersection  uses  only  partial 
information  about  the  sources,  it  leads  to  a  sub-optimal  solution.  To  avoid  the 
underestimation  of  the  actual  covariance  matrix,  the  covariance  intersection 
overestimates  it,  which  obviously  results  in  a  significant  decrease  in 
performance.  To  avoid  both  the  inconsistency  of  the  Kalman  filter  and  the  lack 
of  performance  of  the  covariance  intersection,  a  new  fusion  algorithm,  called 
the  largest  ellipsoid,  is  proposed.  The  latter  provides  a  rigorous  mean  to 
increase  the  estimated  error  covariance  matrix  in  the  Kalman  filter  context. 
The  amount  of  this  increase  is  based  upon  the  intersection  concept  used  in  the 
covariance  intersection.  Nevertheless,  the  proposed  algorithm  does  not 
overestimate  the  intersection  region,  as  does  the  covariance  intersection,  but 
slightly  underestimates  it.  This  will  have  no  effect  on  the  consistency  of  the 
fusion,  since  the  intersection  region  represents  an  upper  bound  for  the  actual 

2CorrelaUon  is  the  linear  association  between  two  random  variables,  usually  measured  by  the  cross-covariance 
matrix. 
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covariance.  The  Kalman  filter  covariance  matrix  is  increased  just  enough  to 
cover  the  intersection  region,  and  it  will  therefore  always  remain  smaller  than 
the  one  resulting  from  the  covariance  intersection. 

This  report  is  organized  as  follows.  The  general  problem  of  data  fusion  is 
stated  in  Section  2.  The  Kalman  filter  is  introduced  in  Chapter  3,  and  in 
Chapter  4  is  presented  the  covariance  intersection.  The  limitation  of  both 
methods  will  be  highlighted,  and  the  new  largest  ellipsoid  approach  is 
proposed  in  Chapter  5.  The  two  methods  are  compared,  in  Chapter  6,  for  the 
target’s  tracking  problem.  The  conclusion  appears  in  Chapter  7. 
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2.  Data  fusion 


The  data  fusion  provides  the  decision  maker  with  an  efficient  tool  to  manage  the 
information  he  might  receive  from  a  variety  of  sources  and  improve  his  current 
situation  awareness,  by  producing  an  “as  accurate  as  possible”  explanatory  picture  of 
the  battle  environment.  According  to  the  JDL  sub-panel  [15],  the  data  fusion  process  is 
subdivided  into  five  levels  (see  Figure  1),  where  each  succeeding  level  deals  with  a 
higher  level  of  information  abstraction.  Level  1,  to  which  we  will  be  particularly 
interested  m  the  sequel,  deals  with  the  object  assessment.  It  uses  the  sensor  data,  from 
Level  0,  to  optimally  estimate  the  current  kinematical  properties  of  the  target,  and 
predict  their  future  positions.  It  also  makes  inferences  about  the  target’s  identity  and 
other  key  attributes.  This  identification  issue  will  however  not  be  considered  in  the 
sequel. 


Figure  1:  The  revised  JDL  data  fusion  model 


2.1  Source  modeling 

In  the  context  of  L1DF,  the  sources  to  be  fused  are  often  assumed  corrupted  by  noise 
and  therefore  modeled  as  random  variables,  whose  true  statistics  are  unknown.  Within 
the  estimation  theory  framework,  such  stochastic  variables  are  often  represented  in 
terms  of  means,  or  estimates,  and  covariance  matrices,  that  is,  the  uncertainties 
associated  with  the  estimation  process.  In  this  context,  the  main  idea  of  data  fusion  is  to 
obtain  an  estimate  of  some  unknown  variable  from  its  two  (or  more)  available 
noise-corrupted,  direct  or  indirect,  observations. 

In  the  case  of  two  sources,  si  and  s  >-,  the  statistical  representation  of  the  available  data 
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(observations)  is  given  by  the  means  si  and  s 2 ,  the  assumed  covariance  of  each  source 


Si  =  E\  sii 


S-2  =  E  s2sl 


and  the  assumed  cross  covariance  of  the  two  sources 


S 12  =  E  sis2  (3) 

where  the  unknown  estimation  error  terms,  si  and  £2,  are  defined  by 

iii  =  si  -  si  (4) 

s2  =  s2  --  s2  (5) 

The  fusion  problem  can  then  be  characterized  as  finding  a  mathematical  method  to 
describe  how  the  information  about  si  and  s2  can  be  used,  in  an  efficient  and  provably 
optimal  way,  to  construct  a  new  estimate  s  (and  an  estimate  of  its  associated  measure  of 
accuracy  S)  which  minimizes  some  cost  function,  while  guaranteeing  consistency.  This 
consistency  notion,  upon  which  will  be  based  the  comparison  of  the  fusion  methods 
presented  in  the  subsequent  sections,  is  a  very  important  issue  in  the  estimation  theory. 

2.2  Consistency 

An  estimate  s  is  said  consistent,  or  conservative,  if  its  stated  level  of  performance  is 
smaller  than  the  actual  one  [16].  If  the  inverse  of  the  covariance  matrix  ( i.e .,  the  Fisher 
information  matrix)  is  used  as  a  measure  of  the  performance,  the  consistency  will  be 
equivalent  to 

S"1  <  S~x  =  S  >  S  (6) 

where  S  is  the  actual  covariance  matrix  and  S  its  estimate  provided  by  the  fusion 
algorithm.  The  inequality  in  (6)  is  a  matrix  inequality,  which  means  that  the  difference 
matrix  is  positive  semi-definite,  i.e.. 


S  >  0 


In  other  words,  this  means  that 


xT(S  -  S)x  >0,  Vxe  Rn 


2.3  Geometric  interpretation 

In  the  remainder,  to  better  show  the  consistency  notion,  the  covariance  (or  k „)  contour 
concept  will  be  used.  For  each  covariance  matrix  P,  a  set  of  ellipsoids  will  be  drawn 
and  serves  as  an  accuracy  measure.  These  ka  ellipsoids  are  defined  by 


x|(x  -  X0)TP  l(x  —  Xq)  = 
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where  k  is  a  constant.  The  (covariance)  matrix  P  determines  then  how  far  the  ellipsoids 
extend  in  every  direction  from  their  center  xo-  This  is  a  geometric  visualization  that 
provides  a  useful  tool  for  comparing  incompatible  matrices.  The  lengths  of  the 
semi-axes  of  Ck  are  given  by  \f\t,  where  \  are  the  eigenvalues  of  the  matrix  P. 

For  a  random  variable,  with  a  covariance  matrix  P,  the  ellipsoids  result  in  contours 
of  constant  probability.  Figure  2  gives  an  example  of  contours  for  a  normally 
distributed  random  variable  in  R2. 


Figure  2:  Representation  of  the  k„  contours  for  a  two-dimensional  random  variable,  with  a  Gaussian  distribution 

and  a  covariance  matrix  P 


2.4  Fusion  rule 

The  updated  estimate  is  often  obtained  via  a  linear  combination  of  the  two  available 
estimates  si  and  s 2 . 


s  =  W1S1  +  W2S2  (10) 

where  the  weights  W\  and  Wo  are  computed  to  minimize  some  cost  function  of  the 
resulting  covariance  matrix  S ,  whose  expression  is  given  by 

S  =  WjSx  Wf  +  Wj512  W2t  +  W2S21W[  +  W2S2W. J  (11) 


In  the  subsequent  sections,  solutions  to  the  fusion  problem  are  discussed.  The  Kalman 
filter  will  first  be  introduced  in  Chapter  3,  where  the  emphasis  will  be  put  on  its 
inconsistency  problem.  The  superiority,  from  the  consistency  viewpoint,  of  the 
covariance  intersection  is  shown  in  Chapter  4.  To  compensate  for  the  decrease  in 


TR  2001-223 


UNCLASSIFIED 


7 


P518345.PDF  [Page:  25  of  71] 


UNCLASSIFIED 


performance  caused  by  the  overestimation  of  the  intersection  region  by  the  covariance 
intersection,  a  new  method  (i.e.,  the  largest  ellipsoid)  is  proposed  in  Chapter  5.  This 
solution  represents  a  good  compromise  between  the  performance  of  the  Kalman  filter 
and  the  robustness  of  the  covariance  intersection. 
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3.  Kalman  filter 


Incontestably,  the  Kalman  filter  is  one  of  the  most  important  tools  in  the  estimation 
theory.  It  has  rapidly  found  a  natural  place  in  the  L1DF  applications,  to  become  one  of 
the  most  used  algorithms.  Within  the  Kalman  filtering  context,  the  cost  function  to  be 
minimized  is  the  trace  of  the  estimation  error  covariance  matrix  5  given  by 
equation  (1 1).  The  Kalman  filter  yields  the  “best”  performance,  regardless  of  the 
underlying  error  distribution.  It  provides  a  mathematically  rigorous  and  provably  stable 
method  for  fusing  information  in  real-time,  and  performs,  in  the  Minimum  Mean 
Square  Error  (MMSE)  sense,  better  than  any  other  linear  filter.  This  MMSE  (or  £2) 
optimality  means  that,  if  a  number  of  candidate  filters  were  run  many  times  on  the  same 
problem,  the  average  result  of  the  Kalman  filter  would  be  better  than  the  average  result 
of  any  other.  Note  that  many  ways  are  possible  to  define  the  optimality,  depending  on 
which  criterion  the  evaluation  of  the  filter  performance  is  based  on. 

3.1  Fusion  of  independent  sources 

Under  the  source  independence  assumption 


5 12  =  S21  =  0 

the  combined  covariance  matrix  (11)  reduces  to 

5  =  WiSxW?  +  W2S2W 2T 

The  solution  to  the  underlying  optimization  problem  is  then  given  by 


Wi  =  S2 
W2  =  Sl 


s1  +  s2 


51  +  52 


-1 


which  results  m  the  following  fusion  algorithm 


’  =  5f*  +  S2 

-l  s  _  o—l  s.  1 


-1 


(12) 


(13) 


L  +  £2-1j 

sr1 

(14) 

1 

-i 

l  +  52-1 

e-l 

*2 

(15) 

(16) 

-is 

2  52 

(17) 

3.2  Consistency 


It  is  clear  that,  under  the  independence  assumption,  the  consistency  of  both  sources  is 
sufficient  to  guarantee  the  consistency  of  the  resulting  estimate  [16].  Indeed,  if 

5i  >  5i  and  S2  >  S2  (18) 


then 


5  >  S 


(19) 
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In  the  case  of  Gaussian  sources,  the  inequality  (19)  becomes  an  equality.  This  means 
that  in  the  case  of  the  independent  sources,  the  actual  error  covariance  is  equal  to  the 
one  estimated  by  the  Kalman  filter,  if  all  the  errors  follow  Gaussian  distributions. 

3.3  Mutlisource  fusion 

The  fusion  algorithm  given  by  equations  (16)  and  (17)  can  be  easily  generalized  to  the 
case  of  n  sources.  This  is  known  as  the  “batch  fusion”  and  expressed  as 

S~l  =  Sj-‘  +  4”1  +  ■  •  •  +  S~x  (20) 

S~ls  —  S^1s\  +  -f - |-S,~1s7l  (21) 

3.4  Fusion  of  correlated  sources 

To  analyze  the  effect  of  the  source  correlation  on  the  performance  of  the  Kalman  filter, 
the  cross  covariance  matrix  of  the  two  sources  is  redefined  as  follows 


Si  Si 


s  1  st 


Sj  S2 


where 


sc  -  ey  SiS2 


This  notation  allows  for  explicitly  showing  the  effect  of  the  correlation  coefficient  g. 


3.4.1  Known  correlation 

If  the  cross  covariance  information,  i.e.  Sc,  is  available,  the  independence 
assumption,  imposed  by  the  Kalman  filter,  can  be  relaxed.  The  filter  will  then 
still  provide  the  “best”  performance,  by  exploiting  this  additional  information. 
The  resulting  optimal  weights  are  given  by 

T  -1  -t 

Wy  =  (S2  -  Sj)  Sy  +  S2-Sc-  Sj 


-  {Si -Sc)  1  +  (S2  -  Sf)  1  {S.-Sc) 


W2  =  (Si  -  Sc)  Si  +  s2  -  sc  -  si 


=  (Si-Sc)  '  +  (S2  -  sj)  (s2-sj)  1 

One  can  easily  show  that  the  resulting  covariance  matrix  will  be  given  by 

1  -1 

S  =  S1-(S1-  Sc)  Si  -  Sc  +  52  -  sj  (Si  -  sj) 
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3.4.2  Unknown  correlation 

Unfortunately,  if  the  correlation  information  is  missing,  the  Kalman  filter 
cannot  theoretically  be  applied.  In  most  situations,  to  allow  for  the  use  of  the 
Kalman  filter,  the  independence  is  often  assumed  and  the  correlation  is  simply 
ignored  in  the  fusion  process. 

Figures  3  (a)  &  (b)  show  the  actual  error  covariance  ellipsoid  (or  ka  contour) 
that  results  from  the  fusion  of  two  correlated  sources,  for  different 
cross-correlation  strong,  assuming  that  this  cross-correlation  is  known.  It  can 
be  noticed  that  the  actual  covariance  ellipsoid  will  always  lie  within  the  region 
defined  by  the  intersection  of  the  covariance  ellipsoids  of  the  fused  sources, 
whatever  the  degree  of  correlation  between  these  sources  is.  From 
Figure  3  (b),  it  is  clear  that  ignoring  the  cross-correlation,  in  the  fusion 
process,  leads  to  an  underestimation  of  the  actual  error  covariance  for  positive 
values  of  the  correlation  coefficient  g. 

This  means  that  the  Kalman  filter  overestimates  its  own  performance,  which 
may  result  in  a  divergence  phenomenon.  One  common  solution,  to  avoid  this 
inconsistency  problem,  consists  in  increasing  artificially  the  estimated 
covariance  matrix,  by  introducing  an  empirically  determined  parameter.  This 
palliative  solution  is  also  known  as  “the  fudge  factor”  [13].  Since  there  is  no 
rigorous  method  for  choosing  this  parameter,  the  stability  and  the  reliability  of 
the  Kalman  filter  can  be  greatly  compromised. 

To  overcome  this  limitation,  some  methods  use  an  approximation  of  the 
missing  cross  covariance  matrix.  An  example  of  algorithms  for  computing  the 
cross-covariance  matrix  is  given  by  the  weighted  covariance  method  [17,  18]. 
It  has  however  been  proven  by  Simukai  [19]  that  it  is  not  possible  to  maintain 
a  consistent  cross-covariance  matrix,  in  any  arbitrary  fusion  architecture.  This 
makes  the  weighted  covariance  only  applicable  in  “small”  fusion  networks 
with  a  known  data  flow.  This  also  the  case  of  the  methods  based  on  the 
redundancy  removal,  like  the  tracklet  fusion  [20,  21]  and  the  information 
filter  [22].  Since  the  aim  of  this  report  is  not  the  comparison  of  the  fusion 
algorithms,  the  above-mentioned  methods  will  not  be  considered  in  the 
sequel.  For  comparative  study  of  the  these  methods,  in  the  context  of  the 
track-level  fusion,  the  reader  is  referred  to  [23]. 

The  covariance  intersection  method,  presented  in  detail  in  Chapter  4,  allows 
for  exploiting  the  full  power  of  decentralized  architectures,  by  using  a  slightly 
different  update  rule  from  the  one  of  the  Kalman  filter.  Without  any 
assumption  about  the  cross  covariance,  it  brings  an  interesting  solution  to  the 
problem  of  the  fusion  in  presence  of  an  unknown  and  un-modeled  correlation. 
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4.  Covariance  intersection 


The  covariance  intersection  [14]  is  a  recent  method  that  can  represent,  in  many 
situations,  a  good  alternative  to  the  Kalman  filter,  since  it  makes  possible  a  consistent 
fusion  of  data  provided  by  correlated  sources.  This  fusion  is  performed  without 
considering  the  cross-correlation  information  nor  assuming  the  independence  of  the 
sources  The  “intersection”  terminology  is  related  here  to  the  geometric  analogy,  based 
upon  the  covariance  k&  contour  plots  (see  Section  2.3). 

By  using  a  Kalman-like  fusion  rule,  the  actual  error  covariance  ellipsoid  will  always  lie 
within  the  region  defined  by  the  intersection  of  the  covariance  ellipsoids  of  the  fused 
sources,  whatever  the  degree  of  correlation  between  these  sources  is  (see  Figures  3  (a) 
&  (b)).  Based  on  this  observation,  and  in  order  to  guarantee  the  consistency,  the 
covanance  intersection  computes  a  covariance  matrix  that  will  always  enclose  the 
intersection  region.  The  latter  represents,  in  fact,  an  upper  bound  for  the  actual 
covariance. 


4.1  Fusion  rule 


In  the  case  of  two  sources,  (£j,  S\)  and  (£2,  ^2).  the  fusion  rule  used  by  the  covariance 
intersection  is  given  by  a  convex  combination  of  both  of  the  estimates  and  the  inverse 
of  the  covariance  matrices.  The  resulting  combined  estimate  can  be  written  as 


£  =  uiW\Si  +  (1  —  lj)W2S2 


(27) 


where  u>  G  [0, 1]  is  a  weight  factor.  This  parameter  offers  an  additional  degree  of 
freedom,  whose  value  is  determined  according  to  the  error  norm  (of  the  combined 
estimate)  one  wants  to  minimize  (see  Appendix  B).  This  may,  for  instance,  be  the 
determinant  (the  product  of  the  eigenvalues),  the  trace  (the  sum  of  the  eigenvalues), 
Coo  (the  maximum  eigenvalue), . .  .etc.  The  minimization  problem,  with  respect  to  W\ 
and  W2,  gives  a  similar  solution  to  the  Kalman  gains,  namely, 


W\  = 

w2  = 


uS1 1 

wSf1 


+  (1  - 

+  (1  -  uj)S2  1 


(28) 

(29) 


and  the  corresponding  fusion  algorithm  can  then  be  expressed  as 

S-1  =  : 1  +  (1  -  u)S2l  (30) 

S-'s  =  ujSi 1£:  +  (1  -  u)5^1£2  (31) 


One  can  easily  show  that,  in  the  case  of  equally  weighted  sources  (w  =  .5),  the 
covariance  intersection  yields  the  same  mean  (estimate)  as  the  Kalman  filter,  that  is 

sci  =  skf  (32) 
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Figure  4:  1a  contour  (for  x  e  R2)  of  the  actual  covariance  matrix  obtained  by  the  fusion  of  two  correlated  sources 
(for  different  correlation  coefficient  values  -  9  <  p  <  9;  and  estimated  covariance  matrix  yielded  by  the  Kalman 
filter  (under  the  independence  assumption,  ie,g  —  0)  and  the  covariance  intersection  update  rules,  respectively 
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Its  corresponding  covariance  matrix  is  however  twice  the  Kalman  filter  one, 

Sci  —  2Skf  (33) 

4.2  Consistency 

It  has  been  proven  [14,  24]  that,  without  assuming  the  independence,  the  combined 
estimate  is  guaranteed  to  be  consistent,  given  the  consistency  of  the  two  sources.  This 
means  that,  if 

Si  >  Si  and  S2  >  S2  (34) 

then 

S  >  S  (35) 

This  statement  remains  true  whatever  is  the  correlation  intensity  g  (see  Figure  4)  and 
the  parameter  to  value  (see  Figure  5).  This  correlation-independent  consistency 
represents  the  unique  and  major  advantage  the  covariance  intersection  has  over  the 
Kalman  filter.  The  covariance  intersection  update  rule  is  however  sub-optimal  in  the 
sense  that  it  results  in  a  covariance  matrix  that  will  always  be  larger  than  the  one 
estimated  by  the  Kalman  filter,  even  if  there  is  actually  no  correlation  (see  Figure  4). 

4.3  Multisource  fusion 

As  for  the  Kalman  filter,  the  generalization  to  the  n-source  case,  of  the  fusion  rule  given 
by  the  equations  (30)— (31),  is  straightforward. 

S  ^  =  ui\S^  ^  +  UJ2S2  *  +  •  •  •  +  uinSn  ^  (36) 

S^s  =  +  W25^"1s2  + - b  UJnS^Sn  (37) 

subject  to 

n 

^>j  =  l  (38) 

J  =  1 

4.4  Comparison 

As  previously  stated,  from  Figure  4,  one  can  notice  that  the  covariance  matrix  estimated 
by  the  covariance  intersection  method  is  always  larger  than  the  actual  one,  which  means 
that  the  estimate  yielded  by  the  covariance  intersection  will  always  be  consistent.  This 
is,  unfortunately,  not  the  case  of  the  estimate  given  by  the  Kalman  filter.  The  case  of 
actually  independent  sources,  and  correlated  sources  with  a  known  cross  correlation, 
are  the  only  situations  where  the  Kalman  filter  is  consistent.  In  these  cases,  the  Kalman 
filter  will  provide  a  solution  which  is  superior  to  the  covariance  intersection,  since  the 
latter,  even  if  it  is  also  consistent,  results  in  a  much  larger  covariance  estimate. 


TR  2001-223 


UNCLASSIFIED 


15 


P518345.PDF  [Page:  33  of  71] 


UNCLASSIFIED 


Figure  S:  1„  contour  (lor  x  6  R2)  of  the  combined  estimate  yielded  by  the  fusion  of  two  correlated  sources,  using 
the  covariance  intersection  update  rule  for  different  values  of  the  parameter  u  (0  <  u>  <  1) 
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In  all  cases  where  the  degree  of  dependence  is  supposed  unknown,  and  the  sources  are 
therefore  assumed  independent,  the  covariance  intersection  is  superior  in  the  sense  that 
it  still  yields  a  consistent  estimation.  The  Kalman  filter  gives,  as  shown  by  Figures  3 
and  4,  an  underestimation  of  the  actual  covariance  matrix,  for  postive  values  of  q.  From 
Figure  4,  one  can  notice  that,  without  any  assumption  about  the  correlation  between  the 
sources,  the  covariance  intersection  was  able  to  provide  a  consistent  fusion  rule.  The 
shown  results  correspond  to  two  correlated  sources,  whose  correlation  coefficient  q  is 
taken  within  the  range  —  .9  <  0  <  .9. 

Finally,  the  effect  of  the  parameter  u>  on  the  performance  of  the  covariance  intersection 
is  observed  in  Figure  5.  The  combined  covariance  reduces  to  the  covariance  of  the  first 
source,  for  lu  =  0,  and  to  the  covariance  of  the  second  source,  for  u  —  1.  For 
0  <  u  <  1  the  resulting  covariance  is  given  by  the  convex  combination  of  the  two 
covariance  matrices.  For  the  case  of  centred  sources3,  the  estimation  is  still  consistent 
independently  of  the  value  of  the  parameter  oj.  Note,  also,  that  for  both  variable  g  and 
variable  to  cases,  the  actual  covariance  always  lies  within  the  intersection  region 
defined  by  the  source  covariance  matrices. 


4.5  Non-centred  sources 

In  all  the  presented  scenarios,  the  data  sources  are  taken  centred,  with  however  different 
covariance  matrices.  In  such  a  case,  the  fusion  algorithm  wdl  only  help  in  reducing  the 
uncertainty  in  the  estimation,  viz.,  the  covariance.  The  estimate  value  will  remain 
unchanged  throughout  the  estimation  process.  For  completeness,  the  more  general  case 
of  non-centred  sources  is  presented,  for  the  same  scenarios,  in  Appendix  A. 

4.6  Alternative  approach 

Since  the  intersection  region  represents  (in  all  directions)  an  upper  limit  for  the  actual 
error  covariance  matrix,  and  the  covariance  intersection  method  overestimates  it,  the 
latter  results  in  a  significant  decrease  in  performance.  This  is  why  the  method  is  said 
sub-optimal.  To  avoid  this  large  overestimation  of  the  covariance,  a  new  filter,  called 
the  largest  ellipsoid  method,  is  presented  in  Chapter  5. 


3Which  provide  the  same  mean. 
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5.  Largest  ellipsoid 


As  in  the  case  of  the  covariance  intersection,  the  design  of  this  filter  is  also  based  on  the 
estimation  of  the  intersection  region  of  the  covariance  matrices.  Instead  of 
overestimating  this  region,  the  new  filter  will  however  slightly  underestimate  it.  This 
will  have  no  consequence  on  the  consistency  of  the  fusion,  since  the  intersection  region 
represents  an  upper  limit.  This  means  that  the  actual  covariance  will  almost  always  lie 
within  the  region  defined  by  the  estimated  covariance.  The  very  rare  cases,  where  the 
actual  covariance  may  partly  lie  outside  the  estimated  one,  are  those  of  highly 
correlated  sources.  And  even  in  those  cases,  the  difference  is  very  small  and  only  due 
the  orientations  of  the  matrices  and  not  to  their  sizes  (trace,  determinant,  etc.). 

Since  the  ka  contour  defined  by  the  actual  covariance  matrix  is  an  ellipsoid,  the 
proposed  filter  computes  the  “largest  ellipsoid”  contained  within  the  intersection 
region.  The  matrix  orientation  problems  may  however  make  the  direct  computation  of 
this  ellipsoid  very  difficult,  and  even  impossible  (see  Figure  6). 

In  the  case  where  the  matrices  have  the  same  orientation,  i.e.,  their  eigenvectors  are 
two-by-two  parallel;  the  ellipsoid  computation  reduces  to  a  comparison  between  the 
eigenvalues  associated  with  each  pair  of  parallel  eigenvectors.  The  eigenvectors  of  the 
intersection  ellipsoids  are  identical  to  those  of  the  fused  matrices.  Nevertheless, 
problems  arise  in  the  more  general  case,  where  the  matrices  do  not  have  the  same 
orientation,  as  illustrated  in  Figure  6,  where  besides  the  ellipsoids,  two  segments  are 
plotted  for  each  matrix.  Each  segment  is  associated  with  an  eigenvector  (and  its 
corresponding  eigenvalue)  of  the  considered  matrix.  This  plots  help  in  getting  a  better 
understanding  of  the  matrix  orientation  incompatibility  problem.  Computing  the  size 
and  the  orientation  of  the  intersection  ellipsoid  is  not  as  straightforward  as  in  the  case 
of  compatible  matrices.  To  solve  the  orientation  incompatibility  problem,  geometrical 
transformations  must  be  applied  to  the  two  fused  matrices. 

5.1  Geometrical  transformations 

The  two  fused  matrices  are  brought,  via  geometrical  transformations,  within  a  space 
where  they  have  compatible  orientations.  This  allows  for  performing  a  simple 
comparison  between  the  eigenvalues  associated  with  their  parallel  eigenvectors.  The 
resulting  matrix,  corresponding  to  the  intersection  ellipsoid,  is  returned  back  to  the 
original  space  by  applying  the  reverse  of  the  applied  transformations. 

Rotation 

The  first  transformation  consists  in  rotating  the  fused  matrices  to  make  the  base  (i.e., 
eigenvectors)  of  the  matrix  S\  aligned4  with  the  base  (see  Figure  7)  of  the  Cartesian 

4This  is  an  arbitrary  choice,  and  the  matrix  S' 2  could  have  been  chosen.  This  would  have  led  to  an  identical 

result. 
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Figure  6:  Eigenvalues  and  eigenvectors  of  the  two  fused  error  covariance  matrices  ST  &  S 2 


plan.  The  following  matrix  represents  this  transformation. 


Tr  =  \vl 


V 


12 


V 


T 


T 


where  v\ }  is  the  jth  eigenvector  of  S\.  The  resulting  matrices  are  noted 

SI  =  TrS.Tj 

St2  =  TrS2Tj 


Scaling 

The  second  geometrical  transformation  is  given  by 


1  0  ...  0 
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Figure  7:  Eigenvalues  and  eigenvectors  of  the  rotated  error  covariance  matrices  S[  &  Si> 

where  Ai  is  the  jlh  eigenvalue  of  S'j .  This  is  a  scaling  transformation  that  makes  equal 
all  the  eigenvalues  of  the  matrix: 

S?  =  TsS\Tj  (43) 

^-T.TrSxTjTl  (44) 

As  shown  in  Figure  8,  this  brings  the  matrices  to  the  space,  where  the  cr-contours 
defined  by  Slr  reduce  to  circles.  Since  for  circles,  all  the  directions  are  similar,  one  can 
take,  as  comparison  dnections,  the  eigenvectors 

Mi  vl2  .  vlf  (45) 

of  the  transformed  matrix 

S2”  =  TsSr2Tj  (46) 

-  T  T,  S2TjT]'  (47) 

whose  er-contours  are  still  ellipsoids.  The  eigenvectors  of  S.j’  will  therefore  serve  as 
eigenvectors  of  the  intersection  ellipsoid.  The  corresponding  eigenvalues  are  given  by 
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Figure  8:  Eigenvalues  and  eigenvectors  of  the  rotated  and  scaled  error  covariance  matrices  Sfr  &  S 


the  diagonal  elements  of  the  following  matrix 


Dr, 


min(All,A2l)  0 

0  min(All,A22) 


0 

0 


0 


0  .  min(Ai1,A2„) 


where  A2j  is  the  jth  eigenvalue  of  S'|r.  Hence,  in  the  transformed  space,  the 
intersection  ellipsoid  is  given  by  (see  Figure  9). 


E  —  V‘2l  ■  ■  ■  v2n  Dmm 


V 


f.l 
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whose  corresponding  matrix  in  the  original  space  (see  Figure  10)  can  be  obtained  by 
applying  the  reverse  transformation,  as  follows 


E  =  T~lT~ 1  E‘’rT~TT1~T 


-2 


-3 


-3-2-1  0  1  2  3 


Figure  9:  Intersection  ellipsoid  in  the  transformed  space 


Besides  the  computation  of  the  largest  ellipsoid  matrix,  a  Kalman  filter  fusion  is  run. 
The  resulting  estimate  (17)  is  kept,  while  the  covariance  matrix  ( 16)  is  dropped  and 
replaced  by  the  computed  one  (50). 


5.2  Comparison 

In  order  to  allow  for  a  better  comparison  of  the  proposed  fusion  rule  with  the  Kalman 
filter  and  the  covariance  intersection,  the  corresponding  1„  contours  are  plotted  in 
Figure  1 1  The  contours  of  the  actual  ei  roi  covariance  matrix,  for  different  values  of  the 
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Figure  10:  Intersection  ellipsoid  in  the  original  space 


cross-correlation  coefficient  (—1  <  g  <  1),  are  also  plotted  to  show  the  consistency  of 
the  largest  ellipsoid-based  fusion.  One  can  easily  notice  the  significant  difference 
between  the  sizes  of  the  ellipsoids  resulting,  respectively,  from  the  covariance 
intersection  and  the  largest  ellipsoid.  As  stated  previously,  the  Kalman  filter  is  still,  for 
the  considered  values  of  g,  suffer  from  inconsistency.  The  reduction  by  the  largest 
ellipsoid  fusion  of  the  estimated  covariance  matrix  size  results  in  an  increased 
performance  (faster  convergence  and  smaller  estimation  error).  While  the  fusion  is  still 
consistent,  the  estimated  covariance  matrix  is  tighter  ( i.e .,  closer  the  actual  one)  than 
the  one  yielded  by  the  covariance  intersection  algorithm.  The  presented  methods  are 
illustrated  and  compared,  in  Chapter  6,  using  the  target’s  tracking  problem. 
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Figure  11:  contour  of  the  combined  estimate,  yielded  by  the  largest  ellipsoid  method  vs  the  Kalman  filter  and 

the  covariance  intersection  for  correlated  sources 
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6.  Application  to  the  track-level  fusion 


The  methods  presented  in  the  previous  chapters  are  illustrated  and  compared  in  this  one 
using  the  target’s  tracking  problem  whose  fusion  network  architecture  is  given  by 
Figure  12.  In  the  tracking  problem,  one  is  interested  in  providing  an  improved  estimate 
of  the  state  vector,  such  that  the  target’s  position  can  be  depicted  as  correctly  as 
possible.  In  a  multi-sensor  environment,  the  tracking  problem  may,  as  explained  below, 
present  both  of  the  independent  and  correlated  source  fusion  cases.  But  since  the 
independent  source  case  admits  the  standard  the  Kalman  filter  as  an  optimal  solution, 
the  emphasis  will  be  put  on  the  more  challenging  correlated  case. 

The  tracked  target  is  assumed  to  be  moving  in  a  2D  space,  where  the  acceleration  acts 
as  an  input5.  The  state  vector  to  be  estimated  is  therefore  composed  of  the  target’s 
coordinates,  viz.,  the  position  and  the  linear  velocity.  With  the  following  state  variable 
notation 


Px] 


LPyJ 


and 


the  equations  of  a  such  a  target  can  be  expressed  as 


(51) 


aifc+l  =  Fkxk  +  Tvk 


(52) 


where  vt  are  random  variables  that  reflect  the  unforeseeable  variation  of  the 
acceleration,  in  both  directions,  and 


Fk  = 


T 

0 

0 

0 


0  ft  O' 
10ft 
0  1  0 
0  0  1 


(53) 


ft  is  the  time  increment.  The  matrix  T,  in  (52),  depends  on  the  model  used  to  represent 
the  discrete-time  nature  of  the  process  noise  vk.  Two  examples  are  given  below.  The 
first  one,  which  is  given  by 


'ft2/ 2  0  ' 

0  ft2/  2 

ft  0 

0  ft 


(54) 


5 Since  the  acceleration  may  change  unforeseeably,  it  is  often  modeled  as  a  random  variable,  and  so  it  will  be 
here. 
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reprensents  to  the  pulse  model,  while  the  following  one 
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is  used  by  the  Brownian  motion  model.  Notice  that  the  latter  requires  four  random 
variables  instead  of  two.  If  the  process  noises  are  assumed  to  have  the  same  standard 
deviation  <5„,  the  pulse  model  results  in  the  following  process  noise  covariance  matrix 
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while  the  covariance  matrix  for  the  Brownian  motion  is  given  by 

q  =  <^rrT 
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(59) 


6.1  Fusion  architecture 

For  any  given  sensor  suite  configuration,  there  can  be  many  different  ways  to  combine 
data  from  the  sensors,  offering  as  many  architectural  options  to  the  data  fusion  system 
designer.  The  architecture  of  such  a  system  can  range  from  a  highly  centralized  to  a 
highly  distributed.  In  the  case  illustrated  in  Figure  12,  one  possible  solution  consists  in 
maintaining  sensor-level  tracks  using  local  sensor  information  at  each  sensor  site, 
finding  (in  a  central  fusion  node)  the  sensor  tracks  that  potentially  represent  the  same 
target  and  then  combining  these  tracks  into  global  tracks.  This  architecture  is  typically 
referred  to  as  “Track-Level  Fusion”.  The  primary  alternative  architecture  assumes  that 
all  of  the  raw  sensor  measurements  ( i.e .,  sensor  contacts)  are  sent  directly  to  the 
centralized  fusion  node  to  be  combined  into  global  tracks.  This  architecture  is  typically 
referred  to  as  “Contact-Level  Fusion”. 
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Figure  12:  Fusion  network  architecture 


6.1 .1  Contact-level  fusion 


The  contact-level  fusion  problem  is  first  considered.  This  corresponds  to  the 
case  of  actually  independent  sources,  since  the  contacts  and  the  estimation 
noises,  at  the  sensor  level,  are  not  correlated.  The  target’s  position  (in  both 
directions),  is  the  only  measured  variable.  This  can  be  represented  by  the 
following  observation  equation 


zik+ 1  ~~ 


(60) 


where  k  +  1  is  the  observation  time,  i  is  the  sensor  number  (=  1,2)  and  Ht  is 
the  observation  matrix  that  is  given,  for  both  sensors,  by 


Hl  = 


1 

0 


0  0  0' 

1  0  0 


(61) 


This  means  that,  based  on  this  partial  observation,  the  fusion  algorithm  will 
have  to  provide  an  estimate  for  both  of  the  position  and  the  velocity  of  the 
target. 


6.1 .2  Track-level  fusion 

The  track-level  fusion  architecture  allows  each  sensor  to  perform  a  maximum 
amount  of  pre-processing  to  generate  sensor  output  decisions.  The  resulting 
target  track  data  is  normally  stored  in  a  track  file.  Hence,  each  sensor 
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individually  maintains  its  own  track  file  based  exclusively  upon  its  own 
measurement  data  processed  by  the  local  tracker.  These  sensor-level  tracks  are 
then  transmitted  to  a  central  fusion  process  responsible  for  both  finding  the 
sensor  tracks  that  likely  represent  the  same  target,  and  for  combining  or  fusing 
these  tracks  into  composite  tracks  to  form  a  master  track  file.  Since  the 
sensor-level  tracks  are  state  vectors,  the  observation  equation  at  central  node 
can  be  expressed  as 


zk+l  =  Hxk^i 


where  the  observation  matrix  H  is  this  time  given  by 

"1  0  0  O' 

H  =  0  1  0  0 

1  0  0  10 
0  0  0  1 


(62) 


(63) 


The  track-level  fusion  approach  has  the  advantage  of  reduced  communication 
requirements  when  compared  with  a  centralized  one,  and  therefore  requires 
much  less  I/O  bandwidth  (reduced  data-bus  loading)  to  transmit  the  data 
between  the  sensors  and  the  central  node.  The  local  tracks  are  periodically 
transferred  to  the  central  processor  rather  than  the  copious  measurement  data. 
If  necessary,  the  sensor-level  tracks  may  also  be  communicated  less  frequently 
than  the  arrival  of  the  sensor  data.  The  approach  also  has  the  advantage  of 
reduced  computational  loading  (m  any  single  processor).  In  military 
applications,  due  to  the  distributed  tracking  capabilities,  the  decentralized 
sensor  fusion  results  in  increased  survivability  when  compared  with 
centralized  systems  [4,  10].  Moreover,  if  one  sensor  becomes  degraded,  its 
observations  will  not  affect  the  sensor-level  tracks  of  the  other  sensors  (i.e., 
the  good  sensor-level  tracks  will  not  be  corrupted  by  the  bad  data).  By 
checking  the  sensor-level  tracks  with  the  central  tracks,  one  may  be  able  to 
detect  any  errors  in  the  sensors.  Then,  when  the  sensor  with  poor  data  is 
finally  recognized,  the  central-level  tracks  can  be  formed  using  only 
sensor-level  tracks  from  un-degraded  sensors  [25]. 


Correlation 

Because  the  process  noise  introduced  by  the  target  behavior  is  observed  by  all 
the  sources  tracking  a  common  entity,  Bar-Shalom  [5]  has  shown  that  the 
tracks  may  be  correlated,  and  that  this  correlation  must  be  considered  in  the 
fusion  process.  The  dependence  between  the  estimation  errors  from  the  two 
track  files  arises  from  the  common  process  noise  entering  into  the  state 
equation  of  the  two  tracking  filters  {i.e.,  the  common  error  source  due  to  the 
target  dynamics),  given  that  the  two  information  processors  follow  the  same 
target.  For  example,  a  sudden  target  maneuver  can  lead  to  a  bias  error  for  both 
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tracking  filters.  The  fact  that  the  two  measurement  noise  sequences  processed 
by  these  different  filters  can  be  assumed  independent  is  not  sufficient  to  ensure 
the  independence  of  the  estimation  errors  in  the  two  track  files. 

After  track-to-track  associations  have  been  determined,  the  local  tracks  that 
correspond  to  the  same  targets  as  seen  by  different  sensors  must  eventually  be 
combined  at  a  later  stage.  An  often-employed,  and  overly  simplistic,  solution 
to  this  problem  is  achieved  by  choosing  the  least  uncertain  set  of 
measurements  and  disregarding  the  remaining  information.  This  is  known  as 
track  selection  or  “best  track  approach”.  The  pitfalls  of  such  a  naive  technique 
are  an  inferior  accuracy  and  reduced  spatial  and  temporal  coverage  [26]. 
Hence,  if  sensor-level  tracks  are  maintained,  they  must  be  combined  at  some 
point  if  significant  benefit  is  to  be  derived  from  the  multi-sensor  fusion 
approach.  The  result  is  central-level  tracks  that  are  updated  with  sensor-level 
track  data  instead  of  with  sensor  report  data.  If  a  central-level  track  is  updated 
with  a  sensor-level  track,  the  usual  assumption  (valid  for  the  case  of  raw 
measurements  with  uncorrelated  measurement  error)  of  error  independence 
from  one  update  period  to  another  is  not  valid. 

Since  it  deals  with  correlated  sources,  the  track-level  fusion  problem  is  more 
challenging  than  the  sensor-level  one.  In  this  case,  the  methods  discussed  in 
Chapters  3  to  5  are  applied  and  compared.  Due  to  its  proven  optimality,  the 
contact  fusion  approach  is  taken  as  a  reference,  in  the  performance  evaluation. 
Nevertheless,  the  performance  is  not  the  unique  comparison  criterion.  The 
consistency  is  another  important  property  that  helps  in  choosing  the 
appropriate  approach  for  a  given  situation.  To  compare  the  different 
algorithms,  the  traces  of  the  actual  and  the  estimated  error  covariance  matrices 
of  the  central  tracker  are  plotted.  All  the  plotted  traces  are  normalized  with 
respect  to  the  trace  of  the  estimated  error  covariance  matrix  yielded  by  the 
contact  fusion  algorithm. 


6.2  Results 

The  presented  results  are  obtain  via  200  Monte-Carlo  runs.  The  used  covariance  matrix 
corresponds  to  the  pulse  model,  with  Sv  =  12  and  h  =  .1.  The  sensor  noise  standard 
deviations  are  given,  respectively,  by  SVx  =  5  and  SVy  =  4  for  the  first  sensor,  and 
6Vx  =  6  and  =  3,  for  the  second  one.  Notice  that  the  sensors  are  not  assumed 
identical,  and  the  positions  in  each  direction  (x  or  y)  is  measured  with  a  different 
accuracy. 

To  obtain  a  comparison  means  between  the  presented  methods,  two  parameters  are 
defined  (see  Table  1).  The  first  one  gc  corresponds,  for  each  considered  method,  to  the 
ratio  of  the  trace  of  the  estimated  covariance  matrix  to  the  trace  of  the  actual  one.  This 
gives  an  direct  measure  of  the  consistency  of  the  fusion  algorithms.  Note  that  a  method 
is  inconsistent,  if  Qc  <  1.  The  second  parameter  gp,  which  is  >  1,  deals  with  the 
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performance.  It  is  defined  by  the  ratio  of  the  trace  of  the  actual  covariance  matrix 
(yielded  by  each  method)  to  the  actual  covariance  matrix  yielded  by  the  centralized 
contact  fusion.  Note  that  the  more  qp  is  close  to  1,  the  more  the  corresponding  method 
is  performent. 

The  Kalman  filter  assumes  the  independence  between  the  sensor-level  tracks,  and 
between  each  of  the  sensor-level  tracks  and  the  central  track.  This  obviously  leads  to 
inconsistency  and  an  increase  in  the  estimation  error.  This  phenomenon  is  clearly 
shown  in  Figure  13,  where  the  fusion  algorithm  underestimates  (—65%)  the  actual  error 
covariance  matrix  ( gc  =  0.35).  Also,  the  estimation  error  increases 
considerably  ( gp  =  1.27).  As  shown  in  Figure  14,  the  covariance  intersection  allows 
for  avoiding  the  inconsistency  of  the  simple  fusion.  The  actual  covariance  matrix  is 
indeed  smaller  than  the  assumed  one  ( gc  —  1.12).  This  consistency  is  however  obtained 
at  the  expense  of  a  significant  decrease  in  performance  ( gp  =  1.20). 

The  results  given  by  Figures  15  &  16  are  conclusive,  since,  while  the  estimate  is  still 
consistent  ( gc  =  1.10),  the  assumed  covariance,  is  much  closer  the  centralized 
contact-level  fusion  one,  than  that  obtained  by  the  covariance  intersection.  Indeed,  the 
actual  error  is  only  10%  lager  than  the  one  obtained  with  the  centralized  contact-level 
fusion,  while  it  is  20%  in  the  case  of  the  covariance  intersection.  The  performance  ratio 
is  given  by  gp  =  1.10.  The  simulation  results  are  summarized  in  Table  1.  It  is  clear  that, 
the  only  consistent  approaches  are  the  covariance  intersection  and  the  largest  ellipsoid. 


Method 

Qp 

Qc 

Contact  fusion 

1.00 

1.01 

Kalman  filter 

1.25 

0.35 

Covariance  intersection 

1.20 

1.12 

Largest  ellipsoid 

1.10 

1.10 

Table  T:  Performance/Consistency  comparison  of  the  fusion  methods 
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Figure  13:  Kalman  filter  track-level  fusion 
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Figure  14:  Covariance  intersection  track-level  fusion 
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Figure  15:  Largest  ellipsoid  track  fusion  ys  contact  fusion 
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Figure  16:  Largest  ellipsoid  vs  covariance  intersection  track  fusion 
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7.  Conclusion 


Data  fusion  algorithms  govern  how  information  about  a  given  system  is  extracted  from 
multiple  source  data.  Data  fusion  provides  the  decision  maker  with  an  efficient  tool  to 
manage  the  information  he  might  receive  from  a  variety  of  sources  and  improve  his 
current  situation  awareness  by  producing  an  “as  accurate  as  possible”  explanatory 
picture  of  the  battle  environment.  The  data  fusion  process  is  subdivided  into  five  levels, 
where  each  succeeding  level  deals  with  a  higher  level  of  information  abstraction.  In  this 
report,  the  emphasis  is  put  on  L1DF,  where,  two  key  algorithms  for  data  fusion,  viz-,  the 
Kalman  filter  and  the  covariance  intersection,  are  presented  and  their  limitations  are 
highlighted.  An  alternative  solution,  which  represents  a  good  compromise,  is  then 
proposed.  In  the  case  of  actually  independent  sources,  or  correlated  sources  with  a 
known  cross  covariance  matrix,  the  Kalman  filter  yields  the  best  performance.  If  the 
correlation  information  is  missing  or  incomplete,  the  filter  will  lead  to  an  inconsistent 
estimate.  The  covariance  intersection  avoids  this  inconsistency  phenomenon,  by  using  a 
more  conservative  fusion  rule.  Unlike  the  Kalman  filter,  the  covariance  intersection 
update  strategy  does  not  make  any  assumption  about  the  source  independence.  This 
property  allows  for  the  covariance  intersection  to  fuse  correlated  sources  with  an 
unknown  cross  covariance.  Nevertheless,  this  results  in  a  decrease  in  performance, 
leading  to  an  only  sub-optimal  solution. 

The  new  proposed  Largest  Ellipsoid  filter  offers  a  good  alternative  to  the  covariance 
intersection  method.  As  in  the  latter,  this  consistent  fusion  approach  is  also  based  on 
the  concept  of  intersection.  Nevertheless,  it  leads  to  a  tighter  estimate,  since  it  does  not 
overestimate  the  intersection  region,  but  slightly  underestimates  it.  This  has  no 
consequence  on  the  consistency  property  of  the  fusion,  since  the  underestimated  region 
represents  an  upper  bound  for  the  actual  covariance. 
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Annex  A 

Fusion  of  non-centred  sources 


The  centred  sources  used,  in  Chapters  3  to  5,  to  analyze  the  consistency  of  fusion 
algorithms,  are  replaced  here  by  the  more  realistic  non-centred  ones.  As  shown  in 
Figures  A.l  and  A.5,  the  results  for  the  Kalman  filter  and  the  largest  ellipsoid  are  very 
similar  to  the  case  of  centred  sources.  The  only  difference  lies  in  the  estimated  value 
(i.e.,  the  centre  of  the  ellipsoid)  that  is  affected,  this  time,  by  the  action  of  the  filters. 

The  consistency/inconsistency  properties  remain  however  the  same. 

A  major  difference  is  noticed  in  the  case  of  a  variable  u>.  Since  the  actual  covariance 
does  not,  this  time,  always  lie  in  the  region  defined  by  the  intersection  of  the  covariance 
of  the  fused  sources,  all  the  ellipsoids  defined  by  the  covariance  intersection  (i.e.  for 
different  values  of  cj)  do  not  enclose  the  actual  covariance.  Indeed,  as  shown  in 
Figure  A.2,  depending  on  the  value  of  the  parameter  lj,  the  actual  covariance  may  be 
partly  outside  the  intersection  region.  Nevertheless,  this  observation  does  not  mean  that 
the  covariance  intersection  filter  will  underestimate  the  actual  covariance.  As  can  be 
observed  in  Figure  A.2,  the  estimate  covariance  contours  are  still  larger  than  the  actual 
ones. 

Figure  A.3  shows  better  the  covariance  intersection  fusion  rule  obtained  by  computing 
the  optimal  value  of  the  parameter  u,  which  is  clearly  consistent.  Figure  A.4  compares 
the  Kalman  filter  to  the  covariance  intersection,  while  Figure  A.5  gives  a  comparison  of 
the  three  methods.  This  figure  shows  clearly  the  superiority  of  the  proposed  approach. 
Even  though  the  computation  is  based  on  non-centred  data  sources,  it  results  in  what 
would  have  been  the  largest  ellipsoid  contained  in  the  intersection  region  if  the  sources 
were  centred.  In  this  case,  the  computed  ellipsoid  will  naturally  be  larger  than  the 
intersection  region,  because  the  latter  is  much  smaller  than  the  actual  covariance.  The 
consistency  property  of  the  filter  is,  however,  still  preserved  since  the  estimated  error 
covariance  matrix  is  always  larger  than  the  actual  one. 
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-  Sources 

Actual  Covariance 
—  Kalman  Filter 


Figure  A.1:  1a  contour  of  the  combined  estimate  yielded  by  the  Kalman  filter  update  rule  and  the  actual  covariance 
for  two  correlated  (non-centred)  sources,  with  variable  correlation  coefficient 
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- Sources 

Cl  w  variable 
-  Cl  Optimal  w 


Figure  A.2  1a  contour  of  the  combined  estimate  yielded  by  the  covariance  intersection  update  rule  (with  variable 
Ui)  and  the  actual  covariance  for  two  correlated  (non  centred)  sources  with  variable  correlation  coefficient 
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- Sources 

Actual  Covariance 
Kalman  Filter 

—  Covariance  Intersection 


Figure  A.4:  contour  of  the  combined  estimate  yielded  respectively  by  the  Kalman  filter  and  the  covariance 
intersection  update  rules,  and  the  actual  covariance  for  two  correlated  (non  centred)  sources,  with  variable 

correlation  coefficient 
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Figure  A.5:  1„  contour  of  the  combined  estimate,  yielded  by  the  largest  ellipsoid  vs  the  Kalman  filter  and  the 
covariance  intersection  for  two  correlated  (non-centred)  sources 
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Annex  B 

Optimization  with  respect  to  uj 


The  parameter  u>  offers,  for  the  covariance  intersection  method,  an  additional  degree  of 
freedom,  whose  value  can  be  determined  to  minimize  a  certain  error  norm  of  the 
resulting  covariance  matrix 


PM  - 


-  1 


wP:1  4  (1  -  w)P/ 1 

a=i  v  *  X2 

P.  1  4  w(Pr'  -  P-1) 

SC‘2  '  252  ' 


Gq  4  ioG\ 


B.1  Determinant  optimization 

For  the  covariance  intersection  method,  and  from  the  expression  of  P^,  the  determinant 
appears  to  be  the  ’’natural”  norm  to  be  minimized.  The  underlying  convex  optimization 
problem6  consists  then  in  finding  uopt  such  that 

i^opt  —  argmindet  (P±) 

OJ 

=  argminlndet  (P*) 

OJ 

—  arg  minima;) 


where 


<p(u i)  =  -  lndet  (Go  4  oiGi) 


with,  as  a  constraint,  0  <  u>  <  1.  Since  Go  =  Gj  is  definite  positive  (a  covariance 
matrix),  one  can  rewrite  the  cost  function  as  follows 


<p(uj) 


In  det 


Gl/2(I  +  wG~ 1/2G1G0'1/2)gJ/2 


-  -  In  det  (G0)  -  lndet  (/ -4  tuG0”1/2G1G0'1/2) 
The  last  term,  in  the  above  equation,  can  be  rewritten  as 


lndet  (7  4  wG0‘ l/2GiG0  1/2)  =  In 


-1/2', 


N 


n  i1  + 


i—\ 


N 


I>( 1  4 


2  =  1 


°Also  known  as  Analytic  Centering  problem 
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where  At  is  the  ith  eigenvalue  of  G0  1^2G\G0  1//2.  This  result  allows  for  rewriting  the 
cost  function  as 

N 

ip(u))  =  —  lndet(Go)  —  In  (l  +  tuA,) 

t=i 

The  two  first  derivatives  of  ip,  with  respect  to  l o,  can  be  obtained  analytically,  and  there 
is  no  need  to  approximate  them  numerically. 


Gradient 

Indeed,  the  gradient  of  the  cost  function  is  given  by 


g(uj)  = 


d(p 

duj 


N 


Ai 


1  +  tuA, 

=  eigiG-^GrG-1'2) 


Tieig(I  +  ojG~1/2G1G~1/2) 

-  ]T  eiglc^Gt 1/2 (/  +  uG^G^Y'Go112 


t=i  L 
N 

=  ~Yeia(GiPi) 

»=i 

=  - Trace(GiP& ) 


Hessian 


Similar  calculations  lead  to  the  following  Hessian  expression 


N 


£ 


1=1 

N 


1  T  uiAl 

Yeig[{GiP*?) 

i=i 

Trace[{GxP& )2] 


Since  the  Hessian  is  always  definite  positive,  the  optimum  will  be  a  minimum 
(Second  Order  Necessary  Condition). 
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Multisource  fusion 

In  the  case  of  a  batch  fusion,  that  is, 


1  (w)  —  Go + Y2 

i=i 

The  gradient  and  the  Hessian  will  be  given  respectively  by 
9{i)  =  (Vy>),  =  - Trace(GtPx ) 


and 


=  (V2^  =  TraceiG^G^) 


Implementation 

If  there  were  no  constraint  on  to,  an  analytic  solution  to  the  above-stated 
optimization  problem  could  have  been  found,  by  setting  g(u)  =  0.  Since  ujopt 
must  be  within  [0, 1],  a  numerical  solution  will  be  used.  The  implementation 
details  will  be  given  later. 


B.2  Trace  minimization 


The  trace  of  the  covariance  matrix  is  another  interesting  cost  function  to  be  minimized. 
As  in  the  determinant  case,  for  practical  reasons,  the  minimization  will  be  applied  to 
the  logarithm  of  the  trace.  The  optimization  problem  is  then  defined  as  follows 


J opt 


=  arg  min  trace  (JP*) 


=  arg  min  trace 


Gq  +  u>G\ 


-l 


—  arg  min  In  trace 


Go  +  coGi 


-l 


with,  as  a  constraint,  0  <  u  <  1.  By  using 

trace  A-1  —  trace  A  det  A-1 

the  minimization  problem  can  be  rewritten  in  the  following  form 

Wopt  =  arg  min  |  In  trace  (Go  +  ojGi)  —  In  det  (Go  +  cuGi) 
=  argmin(/?(w) 
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Gradient 


«<->  - 


du 

91ntrace(Go  +  wGi)  9trace(Go  +  wGi)  9  In  (Go  +  u;Gi) 
9trace(Go  +  wGj)  du>  du> 


=  trace  Gi 
=  trace  Gi 


trace(Go  T  uiGi) 


trace  P 


.-i 


—  trace  Gi(Go  +  wGi) 
trace  GiP* 


-l 


Hessian 

In  the  same  way,  the  Hessian  will  be  given  by 


H(u>)  =  - 1  trace  Gi  [trace  PA  1]  1 1  +  trace  [(GiP*)2] 


Multi-source  fusion 


As  in  the  case  of  the  determinant  optimization,  in  the  case  of  a  batch  fusion, 
the  gradient  and  the  Hessian  will  be  given  respectively  by 


g{i)  =  (Vy?)t 


=  trace  G; 


trace  P- 


-l 


-  trace(G1Pi) 


and 


=  (VV)« 

=  -trace  Gitrace  Gj  [trace  Pr1]-2  +  trace  ( G,  P*  G^  P*. ) 


implementation 


Newton’s  method,  with  appropriate  step  length  selection,  can  be  used  to 
efficiently  compute  oJapu  starting  from  a  feasible  initial  point.  The  following 
algorithm  is  considered 

Wfc+i  =  -  akH~l{u>k)g{tMk) 

where  ak  is  the  damping  factor  of  the  kth  iteration,  which  is  given  by  [27] 


1  +  4 


if  4  <  1/4 
otherwise 
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and 

4  =  VgTH-'g 


is  the  Newton  decrement  of  <p  at  u. 
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